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Abstract —The secrecy performance of a source-channel model 
is studied in the context of lossy source compression over a 
noisy broadcast channel. The source is causally revealed to the 
eavesdropper during decoding. The fidelity of the transmission 
to the legitimate receiver and the secrecy performance at the 
eavesdropper are both measured by a distortion metric. Two 
achievability schemes using the technique of hybrid coding are 
analyzed and compared with an operationally separate source- 
channel coding scheme. A numerical example is provided and 
the comparison results show that the hybrid coding schemes 
outperform the operationally separate scheme. 

Index Terms —hybrid coding, likelihood encoder, joint source- 
channel coding, secrecy, wiretap channel 

I. Introduction 

The secrecy properties of the wiretap channel have been 
studied under a variety of formulations. Shannon m con¬ 
sidered the model of a noiseless wiretap channel where the 
transmitter and the legitimate receiver share a secret key. Other 
works 13 consider the case of a noisy wiretap channel 
where the physical structure of the channel is exploited instead 
of using a secret key. 

The most frequently adopted measure for information theo¬ 
retic secrecy in the literature by far is equivocation, or normal¬ 
ized equivocation to be more precise. Wyner 121 introduced the 
notion of (normalized) equivocation for the study of secrecy 
capacity of a wiretap channel. This secrecy metric uses the 
conditional entropy of the source given what the eavesdropper 
observes H (5'|T^), where E here can be a noisy channel output 
or an ciphered text protected by a secret key depending on 
the setup. When the source is a sequence, this quantity is 
typically normalized over the blocklength, —H{S'^\E). Such 
a metric can be intuitively interpreted as the average statistical 
independence between the source and what the eavesdropper 
observes. 

Inspired by 14), other works Q @1 Q H) IH have taken a 
rate-distortion approach to secrecy in communication systems. 
Instead of using equivocation, the secrecy is measured by the 
average distortion between the source and the eavesdropper’s 
reconstruction of the source by allowing the eavesdropper to 
optimize its estimation. There the goal is to design an encoding 
and decoding scheme such that the source can be delivered 
reliably (lossless or lossy) to the legitimate receiver while a 
high distortion can be forced on the eavesdropper. 

It may not have been straightforward to draw any connection 
between these two secrecy metrics until recent work Eol 
which has shown that equivocation is a special case of the 
distortion secrecy metric if the source sequence realization 
is causally disclosed to the eavesdropper during decoding. 


Specifically, the distortion secrecy formulation with causal 
source disclosure fully recovers the equivocation secrecy for¬ 
mulation by choosing the distortion function to be a log-loss 
function. 

In this work, we investigate the secrecy performance of a 
source-channel communication system composed of an inde¬ 
pendent and identically distributed (i.i.d.) source sequence and 
a noisy memoryless wiretap channel. By causally disclosing 
the source to the eavesdropper and using the distortion secrecy 
metric, it grants us the freedom of considering the general 
formulation of a secrecy problem, which can be particularized 
to the equivocation formulation if needed. A variation of this 
source-channel secrecy model was considered in HI without 
causal source disclosure. Despite an important game-theoretic 
setting, such formulation does not render a strong enough 
secrecy criterion. 

Previous work im considers the same source-channel 
model with causal source disclosure. However, only an oper¬ 
ationally separate source-channel coding scheme was consid¬ 
ered. Recent work on hybrid coding ca and the likelihood 
encoder m in suggests a new way of approaching this 
problem. 

II. Preliminaries 

A. Notation 

A sequence Xi, ..., Xn is denoted by X'^. Limits taken with 
respect to “n —>■ oo” are abbreviated as Inequalities of 

the forms lim sup„_,,oo hn < h and lim inf„_,oo hn > h aie 
abbreviated as hn <„ h and hn >n h, respectively. When X 
denotes a random variable, x is used to denote a realization, 
and X is used to denote the support of that random variable. A 
Markov relation is denoted by the symbol — . We use Ep, Pp, 
and Ip{X]Y) to indicate expectation, probability, and mutual 
information taken with respect to a distribution P; however, 
when the distribution is clear from the context, the subscript 
will be omitted. We use a bold capital letter P to denote that 
a distribution P is random. 

For a distortion measure d : X x y R'*', we use 
E [d{X, F)] to measure the distortion of X incurred by re¬ 
constructing it as Y. The maximum distortion is defined as 

dmax = max d{x,y). 

{x,y)exxy 

The distortion between two sequences is defined to be the 
per-letter average distortion 

n 

= - ^d{xt,yt). 


B. Total Variation Distance 


The total variation distance between two probability mea¬ 
sures P and Q on the same cr-algebra T of subsets of the 
sample space X is defined as 

\\P-Q\\tv= sup \P{A)-Q{A)\. 

Some basic properties of total variation distance are given 
as Property 2 in llTSlI . 

C. Soft-covering Lemma 

We now introduce the soft-covering lemma, which will be 
used in the achievability proof of the joint source-channel 
coding scheme. 


Lemma 1. (Soft-covering, l[T6\l } Given a joint distribution 
Puxz, let be a random codebook of sequences U^(m), 
with m = each drawn independently and Lid. 

according to Pjj. Let 

. n k 

- TTr n Px\u{xt\Ut{m)) Pz\xu{zt\xt, Utimfjl) 

and ^ ^ 

= n Pxixt) Pz\x{zt\xt)- (2) 

If R> I{X]Ul then 


~ PX’^z'‘ llry] — exp(— 7 n) 0, 

for any (3 < . k < (Sn, where 7 > 0 depends on the 

R-I(X-U) 'p 
gap P- 

Ill. Problem Setup and Previous Work 


A. Problem Setup 

Given a memoryless source and broadcast channel, we 
want to maximize the distortion forced on the eavesdropper 
(for estimating the source) while communicating the source 
reliably within a distortion constraint to the legitimate receiver. 
The input of the system is an i.i.d. source sequence S'" 
distributed according to nr=iP‘S('^t) channel is a 

memoryless broadcast channel nr= ,i PYZ\x{yt, Zt\xt). The 
source realization is causally disclosed to the eavesdropper 
during decoding. The source-channel coding model satisfies 
the following constraints: 

• Encoder /„ : S" 1 —;■ (possibly stochastic); 

• Legitimate receiver decoder : 3^" 1 —>• S" (possibly 
stochastic); 

• Eavesdropper decoders {Ps^\z’'S*-^}t=i- 

The system performance is measured by a distortion metric 
d{-, ■) as follows: 

• Average distortion for the legitimate receiver: 


E 




<n Db 


• Minimum average distortion for the eavesdropper: 


min ^ E[d(S'",5")] >„ L'e 
1?=1 


Definition 1. A distortion pair {Db,De) is achievable if there 
exists a sequence of source-channel encoders and decoders 
(/rtiffn) such that 

EK5",5")] <„ Db 

and 

min ^ E[d(5'",S'")] >„ £>e- 

lt = l 

The above mathematical formulation is illustrated in Eig. [T] 


f = 1 ,..., n 



Fig. 1: Joint source-channel secrecy system setup with causal source 
disclosure at the eavesdropper 


B. Previous Result 

Before introducing the new joint source-channel coding 
schemes, we first review the achievability result from previous 
work in of the same problem formulation with an opera¬ 
tionally separate source-channel coding scheme. Although the 
problem was only studied for the case of lossless reconstruc¬ 
tion at the legitimate receiver in M, the result can be readily 
generalized to the case of lossy compression as was formulated 
in Section UlI-AI 


Theorem 1. (Generalized Theorem 2 of MH ) A distortion 
pair {Db, Df) is achievable if 


I{S-Ui) < I{U2-,Y) 

I{S■S\U^) < I{V2-,Y\U2) - I{V2-,Z\U2) 


Db ^ E 


d{S, S) 


Df, <rj minE[d(S', a)] -F (1 — p) min E[d(S', t{Ui))\ 


d^S 


t{ui) 


(3) 

(4) 

(5) 

(6) 


for some distribution PsP s\sPui\sPu'zPv 2 \U 2 Px\V 2 Pyz\x, 
where 

[I{U2-,Y)-I{U2-,Z)] + 

^ ^ ^ 

Since the source coding and channel coding parts of the 
above scheme are almost independent (with some technical 
details), we refer to it as the operationally separate source- 
channel coding scheme - Scheme O. 


IV. Main Results 

This section is organized as follows. We first introduce the 
idea of secure hybrid coding. We then state the result of using 
basic hybrid coding (Scheme I) followed by its proof. We next 
state and briefly discuss the result using superposition hybrid 
coding (Scheme II). Einally, we analytically compare Scheme 
O, I and II, and give a trivial outer bound for completeness. 


























A. Secure Hybrid Coding 

Hybrid coding is a joint source-channel coding technique 
IT^ where 1) the encoder generates a digital codeword from 
the analog source and selects the channel input as a symbol- 
by-symbol function of the codeword and the source; and 2) 
the decoder recovers the digital codeword from the analog 
channel output and selects the source estimate as a symbol- 
by-symbol function of the codeword and the channel output. 
It has been shown that this joint source-channel code is 
at least optimal for point-to-point communication. For the 
purpose of achieving secrecy, the symbol-by-symbol mapping 
(deterministic) to the channel input in the encoding stage is 
modified to be stochastic. 

B. Scheme I - Basic Hybrid Coding 

An achievability region using basic secure hybrid coding is 
given in the following theorem. 


Theorem 2. A distortion pair {Di,,De) is achievable if 


I{U;S) < 
Db > 
De < 


where 


P = min 


/(C/;F) ( 8 ) 

E[diS,fiU,Y))] (9) 

P min E[(i(S', 

ipoO 

-|-(1 —/?) min V\d{S,ij)i{U,Z))] (10) 

[I{U-Y)-I{U-Z)]+ 1 

I{S;U\Z) ’I ^ ^ 


for some distribution PsPu\sPx\SUP y z\x ond function 


The proof of Theorem |2] to be presented next uses hybrid 
coding combined with the likelihood encoder. The general 
idea is that under our choice of the encoder and decoder, 
the system induced distribution P is close in total variation 
distance to an idealized distribution Q by our construction. 
Therefore, by properties of total variation, we can approximate 
the performance of the system under P by that under Q. 


C. Proof Outline of Scheme I 

The source and channel distributions Ps and Pyz\x are 
given by the problem statement. Fix a joint distribution 
PsPu\sPx\suPyz\x- We will use Psn to denote HLi Ps- 

Codebook generation: We independently generate 2"^ 
sequences in W" according to and index by 

TO G [1 : 2"^]. We use to denote this random codebook. 

Encoder: Encoding has two steps. In the first step, a likeli¬ 
hood encoder Pl£;(to|s") is used. It chooses M stochastically 
according to the following probability; 

£(to|s”) 


PLE{m\s'^) = 
where M. = [1 : 2”^], and 




C{m\s'^) = Psn|[;n(s"|u"(TO)). 


( 12 ) 


(13) 


In the second step, the encoder produces the chan¬ 
nel input through a random transformation given by 


Ut=iPx\su{xt\st,Utim)). 


Decoder: Decoding also has two steps. In the first step, let 
PDi(w|y") be a good channel decoder with respect to the 
codebook { it "( a)}a and memoryless channel Py\u- In the 
second step, fix a function </'(•,•)■ Define (jP’{vP^y'^) as the 
concatenation {(j){ut,yt)'\t=i and set the decoder Pd2 to be 
the deterministic function 

PD2(s"|m,y") ^ l{s” = 0 ”(u"(to), y")}. (14) 

Analysis: We can write the system induced distribution in 
the following form: 

("t’ tr”, s”, x”, y”, 2 ”, to, s’") 

4 Psn(s’’)PL£;(TO|s")l{u" = P"(TO)} 

n n 

n Px\su{xt\st,ut) PYZ\x{.yt, Zt\xt) 

Pni(TO|y”)Pn 2 (s’’|TO,y”). (15) 

An idealized distribution Q is defined as follows to help 
with the analysis: 

(m, u", s”, x”, y”, z”) 

1 ^ _ 

- = U''im)}Y[Ps\u{st\ut) 

n n 

n Px\su{.Xt\st, Ut) PYZ\x{yt, Zt\xt). (16) 

t=l t=l 

1) Distortion analysis at the legitimate receiver: Applying 
Lemma [T] and properties of total variation distance, if 

R>IiU;S), (17) 

then 


Ec(n) [||P - QIIt^] < exp(- 7 in) = ei„ 0, (18) 


where the distributions are over the random variables 

Using the same steps as was given in 01 for the analysis 
of the Wyner-Ziv setting, it can be verified that the following 
holds: 


Ecw Ep d{S",S'^) 

< Ep[d{S,(l){U,Y))]+dmaxiiln + Sn), (19) 


if 


R<I{U-Y), (20) 

where 6n —^n 0. 

2) Distortion analysis at the eavesdropper: On the eaves¬ 
dropper side, we make the following observation. Define an 
auxiliary distribution 

n i 

Q«^„(s’,z”) 4 l[Pz{zt) l[Ps\z{sj\zj). (21) 

t=i j=i 

Under Q(’), 


S,- Zi- 


( 22 ) 








Recall that 

QmZ'*S*(w, 2 :”,S*) 

_ 1 
“ 2nR 


Wp z\u{zt\Ut{m)) Ps\zu{s,\zj, Uj{m)) (23) 

j=i 




and under Q, the following Markov relation holds: 
Si- Z,U^{M)- 
Applying Lemma [T] we have 


E, 




Q 


(i) 

Z^S' 


— Q^r. 


TVi 


< exp(-72n) 


if 


(24) 


(25) 


R > I{Z; U) (26) 

where i here can go up to /3n, for any /3 < ^y(S^§\§Y- 
Consequently, 

EcC") [||Qzns< < exp(- 7 in)+ exp(- 72 n). (27) 

Note that (l26ll is a degenerate statement if R > I(Z;U). 


Also note that since i? > 0, we have 

[||Qui(M) - Pu\\j,y] < exp(-73n). (28) 

Therefore, combining (fTHll . (I?7ll . and (fTDll . there exists 
a codebook such that 

n 

“ QmZ'>^sA\tV — 

n 

(30) 

2=1 

n 

^ ^ ||Q 22 ^(M) (^ 1 ) 

2=1 

Ep 5^)j < Ep fd(5^, 5^)j + en (32) 


where Cn = n (2 exp(— 7171 ) + exp(— 7172 ) + exp(— 7173 )) + 

d-max (ei n + 5n) -^n 0. 

Now we can bound the distortion at the eavesdropper by 
breaking it down into two sections. The distortion after the 
time transition /3n can be lower bounded by the following; 


min Ep 

1 

-Y,d[SiMS^-\Z-)) 

i=j 


1 " 

7 ^ min 

1=3 

Ep [diSi,fifS^-\zn)\ 

(33) 

1 " 

7 ^ min 

1=3 

^Ep [d{Si,fu{S^-\Z",M)) 

(34) 

1 " 

7 min 

1=3 

Eg \d{Si,f 3 fS^-\Z",M)) 

m) L 


^ndmax 


(35) 


1 V \ 

= 7 min EQ[d{Si,tpi{ui{M),Zi))] - endmax (36) 

fe ^' tlll(u,z) 

1=3 

> 7 V' min E-p\d{S,'ilJi{U, Z))] - 2t„dmax (37) 

k, . ^ t/ii {u,z) 


where k = {1 — f3)n, j = fin + 1 , (l35|) is from (l29l) . (l36ll uses 
the Markov relation given in and (|57)) uses (I5T]) and the 
fact that 


Q ZiSi\Ui(^^i: — P Z\U P S\ZU • 

Similarly, by repeating the above process by replacing Q 
with Q using (I30L the Markov relation given in (1^^ . and 
the dehnition of Q given in (EU, we can lower bound the 
distortion before time /3n as 

min Ep 

k 

> j'Y] minE-p[d{S,^o{Z))] - Cndmax, (38) 

k “ 'ipoiz) 

2=1 

where k = fin. Collecting (flTll . ([20]), and (1321) and taking the 
average of the distortion at the eavesdropper over the entire 
blocklength n from (|571) and (1551) hnishes the proof. □ 




D. Scheme II - Superposition Hybrid Coding 

An achievability region using superposition secure hybrid 
coding is given in the following theorem. 

Theorem 3. A distortion pair {Df,,De) is achievable if 
I{V-,S) < 

Db > 

De < 


where 

/3 = 

a = 

Ts = 

for some distribution P sPv\sPu\vP x\SUvPyz\x and func¬ 
tion (pf, •). 

The proof of Theorem [3] follows the same line as the proof 
of Theorem [2] with the modihcation of using a superposition 
codebook and the superposition version of the soft-covering 
lemma which was discussed in Corollary VII .8 of ifThll . 

Under Scheme II, the distortion at the eavesdropper can 
potentially experience two transitions at fin and an due to 
the superposition structure of the code. 

E. Scheme Comparison 

The relationships among Scheme O, I and II can be sum¬ 
marized in the following corollaries. 






I{UV-Y) (39) 

E[d(5,<^(U,r))] (40) 

min{/3,a} min E [(((S','!/)o(^))] 

i/>o(z) 

-I- (a — min{/3, a}) min E [(i(S, V'l (C^, ■^))] 

l/ll («,z) 

-|-(1 — a) min 'R[d{S,fi 2 {V, Z))] (41) 

'lp2iv,z) 


( [I{U;Y)-mZ)] + 
I HS-,U\Z) 
[rs-I{Z;V\U)]+ 


,1 


(42) 


(43) 


I{S;V\ZU) 
min{/(U; Y\U), I{UV] Y) - J(S; U)) (44) 


Corollary 1. Scheme II generalizes Scheme I. 

To see this, notice that we can let ?7 = 0 in Theorem [3] In 
fact. Scheme II simplihes to Scheme 1 if fi > a. 





















Corollary 2. Scheme O is a special case of Scheme II. 

This can be verified by using the following assignment of 
random variables from Theorem [T] to [3] 

U ^ U 1 U 2 and V ^ SV 2 

to show that the inequalities ([3]) and ([4]) satisfy the inequality 
(IMl) . = Tj, and a = 1. The equivalence of ([5]) and ([0]) to (HOI) 
and (HTl) can be obtained by using the statistical independence 
of SSUi and U 2 V 2 YZ. 

F. The Perfect Secrecy Outer Bound 
Theorem 4. If {Dh,De) is achievable, then 


I{S;U) 

< 

I{U-Y) 

(45) 

Db 

> 

nd{S,4>(U,Y))] 

(46) 

De 

< 

minE[(i(S', a)] 

CL^S 

(47) 

for some distribution 

PsPu\sPx\suPyz\x 

and function 


This trivial outer bound can be verified by using the 
optimality of hybrid coding for point-to-point communication 
and the fact that the estimation by the eavesdropper cannot be 
worse than the a-priori estimation of the source. 

V. Numerical Example 

We use the same example that was considered in HI. 
The source is distributed i.i.d. according to Bern{p) and 
the channels are binary symmetric channels with crossover 
probabilities pi = 0 and p 2 = 0.3. For simplicity, we require 
lossless decoding at the legitimate receiver. Hamming distance 
is considered for distortion at the eavesdropper. 

A numerical comparison of Scheme I with Scheme O 
is demonstrated in Fig. |2l The choice of auxiliary random 
variable U in Scheme I is SX, which may not necessarily be 
the optimum choice but is good enough to outperform Scheme 
O. Scheme II is not numerically evaluated. However, because 
of Corollary [T] and 121 we know analytically that Scheme II is 
no worse than O or I. 



Fig. 2: Distortion at the eavesdropper as a function of source 
distribution p with pi = 0, P 2 = 0.3. 


VI. Conclusion 

This work has investigated secure joint source-channel cod¬ 
ing under a general information-theoretic secrecy formulation. 
By using hybrid coding, we achieve better performance than 
a previously considered operationally separate source-channel 
coding scheme (O). Although a simple numerical example 
shows that a basic hybrid coding scheme (I) can potentially 
outperform Scheme O, we have only managed to prove ana¬ 
lytically a superposition hybrid coding scheme (II) can fully 
generalize both Scheme O and I. The direct relation between 
Scheme O and I, and whether Scheme II is strictly better than I 
are still open for further investigation. Non-trivial outer bounds 
are yet to be explored. 
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